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Abstract 

We study the consequences of thruthful communication among agents in a 
game-theoretic setting. To this end we consider strategic games in the presence of 
an interaction structure, which specifies groups of players who can communicate 
their preferences with each other, assuming that initially each player only knows 
his own preferences. We focus on the outcome of iterated elimination of strictly 
dominated strategies (lESDS) that can be obtained in any intermediate state of the 
communication process. 

The main result of the paper, Theorem |4.2[ provides the epistemic characteri- 
zation of such "intermediate" lESDS outcomes under the assumption of common 
knowledge of rationality. To describe the knowledge of the players we adapt the 
general framework of Apt et al. |3| to reason about preferences. Finally, we de- 
scribe a distributed program that allows the players to compute the outcome of 
lESDS in any intermediate state. 

An initial, short version of this paper appeared as 1281 . 

1 Introduction 

1.1 Motivation and framework 

In the field of distributed computing one studies communication among processes 
whose task is to compute. Here we are interested in the study of communication among 
rational agents (i.e., agents whose objective is to maximize their utility) whose task is 
to reason. Our main motivation is to capture the idea of an interactive decision mak- 
ing process by means of which a group of communicating agents arrives at a common 
conclusion. In such a process the agents repeatedly combine their local information 
with the new information obtained by means of interaction with other agents, in order 
to deduce new conclusions. 
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To this end we introduce a game-theoretic framework which combines locality and 
interaction. We assume that players' preferences are not commonly known. Instead, 
the initial information of each player only covers his own preferences, and the players 
can truthfully communicate this information in the fixed groups to which they belong. 
So locality refers to the information about preferences and interaction refers to com- 
munication within (possibly overlapping) groups of players. 

This framework is realized by augmenting a strategic game with an interaction 
structure |3 | that consists of (possibly overlapping) groups of players within which 
synchronous communication is possible. 

More precisely, we make the following assumptions: 

• the players initially know their own preferences; 

• they are rational; 

• they are part of an interaction structure and can communicate atomic information 
about their preferences within any group they belong to; 

• communication is truthful and synchronous, 

• the players have no knowledge other than what follows from these assumptions, 
and this is common knowledge. 



1.2 Results 

In this setting we then study the outcome of lESDS started in some intermediate state of 
communication (i.e., after some messages about players' preferences have been sent), 
in particular in the state in which all communication permitted by the interaction struc- 
ture has taken place. The computation of this outcome of lESDS can be viewed as 
an instance for an interactive decision making process described above. Indeed, local 
information consists of players' preferences and new information consists of communi- 
cated atomic information about other players' preferences. In turn, deduction consists 
of an elimination of strategies, and the conclusion is the outcome of lESDS. 

We use the results from our previous work 1 3 1 to prove that this outcome realizes an 
epistemic formula that describes what the players know in the considered intermediate 
state. We also explain how this form of lESDS can be implemented by means of a 
distributed program that allows each player at any intermediate state to use his available 
information and perform the possible eliminations. 

It is important to note that we do not examine strategic or normative aspects of the 



communication here. We shall return briefly to this matter in Section 6 



1.3 Background 

It is useful to clarify the difference between our framework and graphical games 
of [ 19 |. In these games a locality assumption is formalized by assuming a graph struc- 
ture over the set of players and using payoff functions which depend only on the strate- 
gies of players' neighbors. The absence of communication precludes a distributed view 
oflESDS. 
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Our epistemic analysis belongs to a large body of research within game theory 
concerned with the study of players' knowledge and beliefs, see, e.g. |5 1. In particular, 
Tan and Werlang 1251 have shown that if the payoff functions are commonly known 
and the players are rational and commonly believe in each other's rationality, they will 
only play strategies that survive lESDS. In this context rationality entails that one does 
not choose strictly dominated strategies. 

Our framework stresses the locality of information about preferences in combina- 
tion with communication and consequently leads to a different epistemic analysis. In 
particular, in our setting the analysis of players' knowledge requires taking into account 
players' reasoning about group communication. 



1.4 Plan of the paper 



In Section 2 we review the basic notions concerning strategic games, optimality no- 
tions and operators on the restrictions of games. Next, in Section 3 we study the 



outcome of lESDS in the presence of an interaction structure. We first look at the out- 
come resulting after all communication permitted in the given interaction structure has 
taken place, and then consider the outcome obtained in an arbitrary intermediate state 
of communication. 



The connection with knowledge is made in Section 4 where we provide in this 
setting the epistemic characterization of lESDS. Then in Section 5] we describe a dis- 
tributed implementation of lESDS. Finally, in Section 6 we suggest some future re- 
search directions. 

In the Appendices we summarize the used results concerning the epistemic frame- 
work from lO and provide the proofs. 



2 Preliminaries 

Following Osborne and Rubinstein ll2n . by a strategic game (in short, a game) for 
players N ~ {!,..., n}, where rt > 1, we mean a tuple {Si, . . . , Sn, ^i, • ■ • , ^n), 
where for each i ^ N, 

• Si is the non-empty, finite set of strategies available to player i. We write S to 
abbreviate the set of strategy profiles: S = Si x ■ ■ ■ x Sn- 

• is the strict preference relation for player i, so ;^jC S" x S. 

This qualitative approach precludes the use of mixed strategies, but they will not be 
needed in our considerations. 

As usual we denote player i's strategy in a strategy profile s G S hy Si, and the 
tuple consisting of all other strategies by s_j, i.e., s_i = (si, . . . , s,;_i, s^+i, . . . , s„). 
Similarly, we use S-i to denote 5i x • • • x Si-i x Si+i x ■ ■ ■ x Sn, and for s[ G Si 
and s_i e S^i we write (s-, s^^) to denote (si, . . . , Si_i, s^, s^+i, . • . , s„). Finally, 
we use s'; . Si as a shorthand for (s^, S-i) >i {si, S-i). 

In the subsequent considerations each considered game is identified with the set 
of statements of the form s'^ ^s^i Si. Therefore the results of this paper apply equally 
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well to the strategic games with parametrized preferences introduced in ||2l. In these 
games instead of the preferences relations . . . , ;^„, for each joint strategy s-i of 
the opponents of player i a strict preference relation . over the strategies of player i 
is given. So in strategic games with parametrized preferences players cannot compare 
two arbitrary strategy profiles. 

Fix now an initial strategic game Q (5*1, . . . , 5„, . . . , ;^„). We say that 
{S[, . . . , S'„) is a restriction of Q if each S'^ is a subset of Si. We identify the restriction 
(5i,...,5„) withg. 

To analyze iterated elimination of strategies from the initial game Q, we view 
such procedures as operators on the set of restrictions of Q. This set together with 
component-wise set inclusion forms a lattice. 

For any restriction Q' := . . . , S'^) of Q and strategies Si, s'^ E Si, we say 
that Si is strictly dominated by .s- on S'_i, and write s- ys'_- Si, if s- ys'_ Si for 
all s'_j e 5*;^^. Further, we write >z s,; instead of Si )/- s\. Then we introduce the 
following abbreviations (I stands for "local" and g stands for "global"; the terminology 
is from Apt |1J): 



sd^{si, Q') which holds iff strategy Si of player i is not strictly dominated on S'_i 
by any strategy from 5- (i.e., -'3s[ e 5- Vs'_j e Si^ >-s^_^ s,), 

sd^{si, Q') which holds iff strategy Si of player i is not strictly dominated on 
S'_i by any strategy from 5"^ (i.e., ^3s- G Si Vs'_i £ S'_, s- >~s'_. Si). 



So in sd^, the global version of strict dominance introduced by Chen et al. |9|, it is 
stipulated that a strategy is not strictly dominated by a strategy /rom the initial game. 

We call each relation of the form sd^ or sd^ an optimality notion. We say then 
that the optimality notion (f> used by player i is monotonic if for all restrictions Q" and 
Q' and strategies Si, Q" C Q' and (/)(si, G") implies (/)(si, G')- 

In our analysis we are interested in the customary notion of strict dominance, which 
is the local notion sd^. However, to obtain the desired results we use its global counter- 
part, sd^, which, as noted in |7, 1), is monotonic, while sd^ is not. The relevant result 
equating the iterations of the operators associated with these two notions of dominance 



is provided in Lemma 3.1 below. 

Given an operator T on a finite lattice {D,C) with the largest element T, X E D, 
and fc > 0, we denote by T''{X) the fc-fold iteration of T starting at X, so with 
T°{X) = X, and put T°°(X) n;,>o T''{X). We abbreviate T"(T) to T". 

We call T monotonic if for all X^Y e D, we have that X CY imphes T{X) C 
T(Y) , and contracting if for slII X e D we have that T{X) C X. 

Finally, as in |3|, an interaction structure H is a hypergraph on N , i.e., a set of 
non-empty subsets of iV, called hyperarcs. 



3 Iterated strategy elimination 

In this section we define procedures for iterated elimination of strictly dominated strate- 
gies. Let us fix a strategic game G = {Si, . . . , 5„, . . . , ^n) fo r players N , an 



interaction structure H C 2 \ {0}, and an optimality notion 4>. In Section 3.1 



we 
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look at the outcome reached after all communication permitted by H has taken place, 
that is, when within each hyperarc of H all of its members' preferences have been 
communicated. In |Section 3.2| we then look at the outcomes obtained in any particu- 
lar intermediate state of communication. We stress that in general there is no relation 
between the preferences and H. 

The formulations we give here make no direct use of a formal notion of knowledge. 



The connection with a formal epistemic model is made in Section 4 



All iterations of the considered operators start at the initial restriction (5*1, . . . , Sn)- 

We start by relating the global and the local version of strict dominance, slightly 
overloading notation by letting sd^{Q') — {si £ S'^ \ s(f{si,G')}, and similarly for 
sd^. The two notions are equivalent in the following sense. 

Lemma 3.1. Let Q'^,Q^, ... be a sequence of restrictions of the initial restriction 
(S'i,...,5„), such that = (S'i,...,5„) andsd3{g^) C g^+^ C g'^forallk> 0. 
Then for all k > 0, sd^^g^) = sd'^{g^). 

Intuitively, this claim can be stated as follows. Suppose that each restriction is 
obtained from g^ by removing some set of strategies that are strictly dominated in the 
global sense. Then the local and global strict dominance coincide on each considered 
restriction g^ . As a consequence, the result also holds if the strategies removed are 
required to be strictly dominated in the local instead of the global sense. 

At the end of this section (in [Theorem 3.7[ ), we show that the operators we define 
in this section produce sequences that satisfy the conditions of [Lemma 3.1| and thus 
coincide for the global and the local version of strict dominance. 



3.1 Completed communication 

Let us assume that within each hyperarc A E H, all players in A have shared all in- 
formation about their preferences. We leave the exact definition of communication to 
[Section 32\ and the epistemic formalization to [Section 4] and focus here on an opera- 
tional description. 

For each group of players A £ N, let Sa denote the set of those restrictions of g 
which only restrict the strategy sets of players from A. That is, 

Sa {{S[, ■■■,S'J\ S'i C Safari e A and S', = 5"^ for i ^ A}. 

Now we introduce an elimination operator Ta on each such set Sa, defined as follows. 
For each g' ^ {S[, . . . , S'„) & Sa, let TAig') (SI, ...,S'J,), where for all i e N, 

^„.^ r {s,eSl\cj){s,,g')} iiteA 
' ' \ SI otherwise. 

We call the outcome of iterated elimination (of non-(/)-optimal strategies) on A. 

We then define the restriction g{H) of g a^g{H) := {g{H)i,. . . , g{H)n), where 
for all i e N, 

'Here and elsewhere the outer subscript 'i' refers to the preceding restriction. 
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Figure 1: Illustrating Example 3.2 Hyperarcs are shown in gray. Callouts attached 
to hyperarcs represent communicated, and thus commonly known, information. The 
thought bubble represents private information, in this case obtained from the combina- 
tion of information only available to player 1. 



That is, the ith component of Q (H) is the zth component of the result of applying T^jj 
to the intersection of for all A £ H containing i. We call Q{H) the outcome of 
iterated elimination (of non-(/)-optimal strategies) with respect to H. Note that both 
T and G{H) implicitly depend on (f> and that T is contracting. While this definition 
is completely general, we shall use it with (f> E {sd^,sd^}, and as shown later in 
[Theorem 3.7| the outcome for both cases coincides. 

Let us "walk through" this definition to understand it better. Given a player i and 
a hyperarc A E H such that i E A, is the outcome of iterated elimination on A, 
starting at (5*1 , . . . , 5'„). The strategies of players from outside of A are not affected by 
this process. This elimination process is performed simultaneously for each hyperarc 
that i is a member of. By intersecting the outcomes, i.e., by considering the restriction 
C\A ieAeH -^yT' ^'^^ arrives at a restriction in which all such "groupwise" iterated elim- 
inations have taken place. However, in this restriction some of the strategies of player i 
may be non-(/)-optimal. They are eliminated using one application of the T^jj operator. 
We illustrate this process, and in particular this last step, in the following example. 

Example 3.2. Consider local strict dominance, sS, in the following three-player game 
Q where the payoffs of players 1 and 2 and those of players 1 and 3 respectively depend 
on each other's actions, but the payoffs of player 2 and 3 are independent: 



PI. 2,3 



L,l 



L,r 



R,l 



R,r 



PI. 1 



U 
D 



1,1,1 


0,1,0 


0,0,1 


0,0,0 


0,1,1 


1,1,0 


1,0,1 


1,0,0 



So, for example, the payoffs for the strategy profile {U, L, r) are, respectively, 0, 1, 
and 0. Now assume the interaction structure H — {{1, 2}, {1, 3}}. We obtain 7{^9} = 
{{U,D},{L},{l,r}) andT^^gj = {{U,D},{L,R},{1}). The restriction defined by 
these two outcomes is {{U,D},{L},{1}), and in the final step player 1 eliminates 
his strategy D by one applica tion of T| i].. The outcome of the whole process is thus 
g{H) = {{U}, {i}, {I}). See [Figure! for an illustration of this situation. □ 



In this example, the outcome with respect to the given interaction structure coin- 
cides with the outcome of the customary lESDS on the fully specified game matrix. We 
should emphasize that this is not the case in general, and the purpose of this example is 
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simply to illustrate how the operators work. Example 3.4 later on shows in a different 
setting how the interaction structure can influence the outcome. 

Note that when H consists of the single hyperarc N that contains all the players, 
then for each player i. Ha ieAeff "^A reduces to T^, and this is closed under applica- 
tion of each operator So then, indeed, Q{H) — T\ 
case coincides with the customary outcome of iterated elimination of non 
strategies. 

In general, this customary outcome is included in the outcome w.r.t. any hyper 



^ , that is, G{H) in this special 



-optimal 



graph H. This result is established in Theorem 3.3 and Example 3.4 shows a case 
where the inclusion is proper. 

Theorem 3.3. For (p e {sd^, sd^} and for all hypergraphs H, we have C Q{H). 

The inclusion proved in this result cannot be reversed, even when each pair of play- 
ers shares a hyperarc. The following example also shows that the hypergraph structure 
is more informative than the corresponding graph structure. 

Example 3.4. Consider the following strategic game with three players. The payoffs 
of player 1 and 2 depend here only on each other's choices, and the payoffs of player 3 
depend only on the choices of player 2 and 3: 



PI. 2 



R 



PI. 2 

L R 



PI. 1 



U 
D 



0,1 


0,0 


1,0 


1,1 



PI. 3 



A 
B 






1 


1 






Payoff of players 1 and 2 



Payoff of player 3 



So, for example, the payoffs for the strategy profile {U,L,A) are, respectively, 0, 
1, and 0. If we assume the hypergraph H that consists of the single hyperarc {1, 2, 3}, 
then the outcome of iterated elimination of non-(/)-optimal strategies w.rt. H is the 
customary outcome which equals {{D}, {R}, {A}). Indeed, player 1 can eliminate his 
strictly dominated strategy U, then player 2 can eliminate L, and subsequently player 3 
can eliminate B. 

In contrast, if the hypergraph consists of all pairs of players, so H = {{1,2}, 
{2, 3}, {1, 3}}, then the outcome of iterated eUmination of non-0-optimal strategies 
w.rt. H equals ({£>}, {i?}, {A, B}). 

Informally, the reason for this difference is that in the latter case, player 3 can 
eliminate B only using the fact that player 2 eliminated L, but this information is 
available only to players 1 and 2. □ 



3.2 Intermediate states 



The setting considered in Section 3.1 corresponds to a state in which in all hyperarcs all 
players have shared all information about their preferences. Given the game Q and the 
hypergraph H, the outcome Q (H) there defined thus reflects which strategies players 
can eliminate if initially they know only their own preferences and they communicate 
all their preferences in H. We now define formally what communication we assume 
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possible, and then look at intermediate states, where only certain preferences have been 
communicated. 

Each player i can communicate his preferences to each A E H with i E A. A mes- 
sage by i consists of a preference statement s'^ '^s^i Si for Si, s' € 5*^ and S-i G 
We denote such a message by {i, A, s'^ . s^) and require that i E A and that it is 
truthful with respect to the given initial game Q, that is, indeed s'^ ^s^i Si in Q. Note 
that the fact that i is the sender is, strictly speaking, never used. Thus, in accordance 
with the interpretation of communication described in [Section we could drop the 
sender and simply write "the players in A commonly observe that s'^ ^s^i Sj-" An 
intermediate state is now given by the set M of messages which have been commu- 
nicated. 

We now adjust the definition of an optimality notion to account for intermediate 
states. An intermediate optimality notion (j)A,M (derived from an optimality notion 
(p) uses only information shared among the group A in the intermediate state given 
by M. So with singleton A = {i} only i's preferences are used, and with larger A only 
preferences contained in messages to a superset of A are used. Thus in the case of sd^ 
we have that 

• ^4},Af(«''^') holds iff-3sj E 5, Vs_, E S'_, s[ >s_^ 

• sd\j^j{s,,g') holds iff -3s,^ E S, Vs_, E SL, M s[ s, 

where A ^ {i} and by M s\ >~s-i we mean that s\ >-s-i Si is entailed 
by those messages in M which A received. 

More precisely, the entailment relation 

M UN s', s, 

holds iff there exist messages (•,A'=,s^^ ys_, e Mforfc e {1,...,^- 1} such 

that A'' D A, sj = s- and = Si. 

We now define a generalization of the Ta operator by: 

where Q' ^{S[,..., S'J and for all i E N, 

S': ■.= {s,eS[\^amM)}. 

Note that, as before, S[ remains unchanged for i ^ A, since then (f)A,M{si, G') always 
holds. Indeed, for it to be false, there would have to be some message (i, A, ■) E M, 
which would imply i E A. 

Similarly, we now define the outcome of iterated elimination (of non-i/i-optimal 
strategies) with respect to H, M to be the restriction Q{H,M), where ioi i E N 

g{H,M), := (r{,},,, {nA:eAeHTA.M))r 
Here H denotes the closure of H under non-empty intersection. That is, 

H = {A,n---nAk \ {Ai,...,Afc}cH}\{0}. 
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M 



Figure 2: Illustrating Example 3.5 



The use of H is necessary because certain information may be entailed by messages 
sent to different hyperarcs. For example, with (j, A, s" >s-j s'j) , {j , A' , s'^ ^s^j Sj) € 
M, the combined information that s" s, is available to the members of A n A'. 

Again, let us "walk through" the definition of G{H, M). First, a separate elimi- 
nation process is run on each hyperarc of H, using only information which has been 
communicated there (which now no longer covers all members' preferences, but only 
the ones according to the intermediate state M). Then, in the final step, each player 
combines his insights from all hyperarcs of which he is a member, and eliminates any 
strategies that he thereby learns not to be optimal. 

It is easy to see that in the case where the players have communicated all there is to 
communicate, i.e., for 



Mf 



{{i, A, s[ Si) \ i £ N,Ae H, s„ s[ G S, with s[ Si in G}, 



the intermediate outcome coincides with the previously defined outcome, i.e., 

This corresponds to the intuition that G{H) captures the elimination process when all 
possible communication has taken place. In particular, all entailed information has 
also been communicated in M^'\ which is why we did not need to consider H in 
[Section 3.11 



Example 3.5. The process described in this example is illustrated in Figure 2 Con- 
sider again the game Q from Example 3.2 and the initial state where M = 0. We 
have T^j^j = Q for all A E H, that is, without communication no strategy can "com- 
monly" be eliminated. However, players 2 and 3 can "privately" eliminate one of their 
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strategies each, since each of them knows his own preferences, so 

T{i}MnA:ieAeHTT,M) = i{U,D},{L,R},{l,r}), 
Ti2}MnA:2eAeHTA,M) = iW, D} , {L} , {l,r}) , 
TmMnA:3eAeHTT,M) = iW, D} , {L, R} , {I}) , 

This ehmination cannot be iterated further by other players and the overall outcome is 
g{H,M) = {{U,D},{L},{l}). 

Consider now the intermediate state M' = {(2, {1, 2}, L R) \ s-2 e S-2}, 
that is, a state in which player 2 has shared with player 1 the information that for any 
joint strategy of players 1 and 3, he prefers his strategy L over R. Then only the result 
of player 1 changes: 

T{i}M'inA:ieAeHTTM') ^ mD},{L},{l,r}), 

while the other results and the overall outcome remain the same. If additionally player 3 
communicates all his information in the hyperarc he shares with player 1, that is, if the 

intermediate state is M" = M' U {(3, {1,3}, I ^s^^ r) \ s_3 e S-s}, then player 1 
can combine all the received information and obtain 

T{i},M"inA:ieAeHTXM") = {{U},{L},{1}). 

This is also the overall outcome Q{H, M"), coinciding with the outcome g{H, Afg!') 
where all possible information has been communicated. □ 

Let us now illustrate the importance of using entailment in the intermediate opti- 
mality notions and H (rather than H) in the definition of g{H, M). 

Example 3.6. We look at a game involving four players, but we are only interested in 
the preferences of two of them. The other two players serve merely to create different 
hyperarcs. The strategies and payoffs of player 1 and 2 are as follows: 

PI. 2 



PI. 1 





L 


R 


A 


3,0 


1. 1 


B 


2,0 


1,1 


C 


1: 1 


0. 


D 


0,0 


5.1 



For players 3 and 4 we assume a "dummy" strategy, denoted respectively by X 
and Y. Consider the hypergraph H = {{1, 2, 3}, {1, 2, 4}} and the intermediate state 

M = {{I, {l,2,i}, A ^LXY B), 
{I, {1,2, A}, B^LXY C), 
(l,{l,2,3},A^fixy C)}. 
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Figure 3: Illustrating Example 3.6 Strategies of the dummy players are omitted. A >- 
C stands for A )^s_i and y^c combines for a G {A, B, D}. Note that in the 
first step, information is not explicitly communicated but deduced. 



The fact that player 1, independently of what the remaining players do, strictly prefers A 
over C is not explicit in these pieces of information, but it is entailed by them, since 
A >LXY B and B >lxy C imply A >lxy C. However, this combination of 
information is only available to the players in {1, 2, 3} n {1, 2, 4}. 

Player 2 can make use of this fact that C is dominated, and eliminate his own strat- 
egy L. If we now look at a state in which player 2 has communicated his relevant 
preferences, so M' = M \J {(2, {1, 2, 3}, i? >aXY L)\a <E {A,B,D}}, we notice 
that player 1 can in turn eliminate A and B, but only by combining information avail- 
able to the players in {1,2, 3} n {1, 2, 4}. There is no single hyperarc in the original 
hypergraph which has all the required information available. It thus becomes clear that 
we need to take into account iterated elimination on intersections of hyperarcs. 



The whole process is illustrated in Figure 3 □ 



Finally we show that, as mentioned before, our definitions and results do not depend 
on the choice of strict dominance relation. 

Theorem 3.7. For any hypergraph H and set of messages M, the outcome Q{H, M) 
does not depend on the choice of (f) {sd^ ^ sd^}. 

This result allows us to restrict attention to global strict dominance in the subse- 
quent considerations, which makes the formulations and proofs simpler. 



4 Epistemic foundations 

In this section, we provide epistemic foundations for our framework. The aim is to 
prove that the definition of the outcome Q{H,M) correctly captures what strategies 
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the players can eliminate using all they "know", in a formal sense. 



We proceed as follows. First, in Section 4.1 we briefly introduce an epistemic 



model formalizing the players' knowledge. In Section 42\ we give a general epis 



temic formulation of strict dominance and argue that it correctly captures the notion. 



Section 4~2] also contains the main result of our epistemic analysis, namely that the 



outcome G{H, M) indeed yields the outcome stipulated by the epistemic formulation. 



We rely on the basic framework and results from |3 1, which we recall in Appendix A 

We focus on the global version of strict dominance, sd^, mainly because the pre- 
sentation is then more concise. However, our results carry over to the local version sd^ 



due to the equivalence result mentioned in the proof of Theorem 3.3 



4.1 Epistemic language and states 

Again, we assume a fixed game Q with non-empty set of strategies Si for each player i, 
and a hypergraph H representing the interaction structure. Analogously to (|3l, we use a 
propositional epistemic language with a set At of atoms which is divided into disjoint 
subsets Ati, one for each player i, where At^ — {s'^ >s-i Si \ Si, G Si, s_i G S-i}. 

The set Ati describes all possible strict preferences between pairs of strategies of 
player i, relative to a joint strategy of the opponents. We consider the usual connectives 
A and V (but not the negation ^), and a common knowledge operator Ca for any 
group A C N of players. As in Q, we write Ki for C{i}. By £+ we denote the 
set of formulas built from the atoms in At using these two connectives and knowledge 
operators. 

A valuation V is a subset of At such that for each s_i £ S-i, the restriction 
Vn{- ^s-i - jisa strict partial order 

Intuitively, a valuation consists of the atoms assumed true. Each specific game Q 
induces exactly one valuation which simply represents its preferences. However, in 
general we also need to model the fact that players may not have full knowledge of the 
game. The restriction imposed on the valuations ensures that each of them is induced 
by some game. 

So for example {s t} is a valuation (given a game with appropriate strategy 
sets), while {s t, t u] and {s >a t, t >a s} are not. 

Recall from Section 3~2l that a message from player « to a hyperarc A £ H has 



the form (z, A, s'- >-s_i Sj), where i £ A, Si, s^ G Si, and s_i G S-i. We say that a 
message (•, •, p) is truthful with respect to a valuation Vifp^V.A state, or possible 
world, is a pair {V, M), where F is a valuation and M is a set of messages that are 
truthful with respect to V . 

This setting is an instance of the framework defined in 13j, and the formal seman- 
tics defines in a customary way when a formula is true in a state (V, M), written as 



{V, M) \= Lp (see Appendix A for a brief summary). We repeat here only the intu- 
ition that Ca^ means that (p is common knowledge among A, that is, everybody in A 
knows ip, everybody knows that everybody knows Lp, etc. In particular, KiLp means 
that player i knows ip. We assume that each player i initially knows the true facts in 
Ati entailed by the initial game Q and that the basic assumptions from Section 1.1 are 
commonly known among the players. 
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4.2 Correctness result 



We use results from |3 1, summed up in Appendix A in order to prove that for sd^, the 



global version of strict dominance, the Tq operator defined in |Section3] is correct with 
respect to an epistemic formulation of our setting. 

We start by giving a formula describing the global version of iterated elimination 
of strictly dominated strategies in the customary strategic games. We define, for z e -/V 

and Si € Si, 

domm^{s,) := Vs'^es. As_.eS-, s„ 



The following simple result relates this formula to the Tjy operator (that is, Tq 
where G is the group of all players), where we assume sd^ as the optimality notion. 

Proposition 4.1. For any strategic game G, i > I, and i Cz N 

iT^)i = {si I -^domin^{si)}. 

Consequently 

{T^)t = {si I ^domin°°{si)}. 

We now modify the above formula to an epistemic formula describing the iterated 
elimination of strictly dominated strategies (in the sense of sd^) in strategic games with 
interaction structures. In contrast to the above formulation the formula below states that 
player i knows that a strategy is strictly dominated. 

We define, for i E N and Si G Si, 



That is, in the base case, player i knows that Si is strictly dominated if i knows that 
there is an alternative strategy s'^ which, for all joint strategies of the other players, is 
strictly preferred. Furthermore, after iteration £+1, i knows that Si is strictly dominated 
if i knows that there is an alternative strategy s'^ such that, for all joint strategies s-i 
of the other players, either s'^ is strictly preferred or some strategy sj in s_j is already 
known by player j to be strictly dominated after iteration i. 

Note that for £ > I each dom^{si) is a formula of £+ that contains occurrences of 
all Kj operators. We restrict our attention to formulas dom^{si) with £ E {!,...,£}, 
where I = X^ieArl'^il- 'heir semantics there is some £ within this range such that 
for all £' > £, dorr/ is equivalent to don/ . To reflect the fact that this can be seen as 
the outcome of the iteration, we denote dorr/ by dom°°. 

We now proceed to the main result of the paper. We prove that the non-epistemic 



formulation of iterated elimination of non-sd^-optimal strategies, as given in Section 3 
coincides with the epistemic formulation of strict dominance. 
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Theorem 4.2. For any strategic game Q, hypergraph H, set of messages M truthful 
with respect to Q, and i Cz N, 

g{H,M), = {s, e I {V,M)i^ dom°°{s,)}, 

where V is the valuation induced by Q. 



5 Distributed implementation 

The epistemic model introduced in [Section 4] allows us to reason about the players' 
knowledge. However, this model tells us what the players can know — assuming they 
are perfect reasoners — from the perspective of an outside observer. The aim of this 
section is to "localize" this centralized analysis to each player, thus obtaining a dis- 
tributed program that allows each player at any intermediate state to use his available 
information to perform the possible strategy eliminations. 



In Section 5. 1 we present a knowledge module that enables each player to correctly 



evaluate a class epistemic formulas, which includes the dom (sj) formulas. Using the 



results from Section 4 and Appendix A it is easy to see that the knowledge module is 
correct with respect to the given class of formulas. Then in |Section 5.2| we discuss the 
overall distributed program that allows each player to implement lESDS. It makes use 
of synchronous communication and refers to the knowledge module. 

We assume that the program of any player i stores and can at any time access the 
initial strategy sets . . . , S",;) of the given game Q, the given interaction structure H, 
i's own preferences >i induced by Q, as well as the messages Mi he has observed. For 
the sake of clarity, we use C{Mi) to denote the transitive closure of the messages that 
have been observed by i. That is, C{Mi) is the smallest set of messages such that 
M, C C{M,), and if {j, A, s'^ ^ s^), (j, A', s^- ^ ^ Sj) G C{M,), then also 

5.1 Knowledge module 

The knowledge module keeps track of the relevant information, i.e., the observed mes- 
sages, and provides an appropriate evaluation function. This function correctly evalu- 
ates a class of formulas, including the dom^ formulas. More precisely, for each ip e £+ 
and intermediate state M, the evaluation function determines whether {V, M) \= Kiip, 
where V is induced by Q. Note that, even though (V, M) refers to all players, the 
knowledge module is only allowed to use the information available to player i, that is, 
and AL. 



The straightforward implementation is described in Algorithm 1| To test whether 
a player i knows a formula ip € he needs to execute eval{i, ip). For a sequence 
of players w — ii . . .i^, we write Kjj} to abbreviate Ki-^ . . . Kt^ and Set{w) to de- 
note {ii, . . . , ik}- The evaluation uses recursion, directly reflecting the semantics as 
defined in [Appendix A| It analyzes the input formula and evaluates its components, 
collecting the encountered K operators until an atom is reached, over which the chain 
of collected K operators is then evaluated. This procedure works correctly because 
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Algorithm 1: Knowledge evaluation function eval{w, (p) of player i 



Input: w e N* , ip e C+ 

Output: true if (V, M) \= K^ip; false otherwise 
1 switch Lp do 



2 case p e At 

3 if Set{w) C {i} and p S At^ then return true iff p e;^^; 

4 else if {■,A,p) e C{Mi) with some A D Set{w) then return true; 

5 else return false; 

6 end 

7 case (^1 A (/3 2 return eval{w,ipi) and eval{w,ip2)', 

8 case V ip2 return eval{w, (pi) or eval(w, ip2)\ 

9 case ifji/?' with j e N 

10 if S'e^(w) U {j} = {i} or there is A & H with Set{w) U {j} C A then 

11 return eval{w o i, (^'); 

12 else return false; 

13 end 



14 end 



distributes over all connectives we use, as established in |Theorem A.3| Some com- 
ments on particular lines of the algorithm follow. 

Line|3] reflects the fact that player i knows his own preferences. 



Lines|4]and|5] reflect Lemma A. 4 with M replaced by Af^ in line[5]since i G Set{w) C 



A; intuitively, the respective message has been sent to A if and only if i has ob- 
served it, since i E A. 

Line[lT] is correct because of lTheorem A. 31 

Line [12] allows the evaluation to be stopped if the set of collected K operators is not 
included in any A £ H. This is due to the fact that iterated knowledge can 
only come through jointly observed messages, which is only possible for groups 



Ae H (compare the last step in the proof of Lemma B.3 1 



5.2 Distributed program 

The distributed program consists of a parallel composition of sequential processes, one 
for each player The process for player i is a main loop that consists of synchronous 
communication statements receiving or sending a message from or to a group A such 
that i E A E H. Each message is a truthful statement of the form s'^ ^s^t Si and is 
randomly selected, since we do not consider why messages are sent. Whenever com- 
munication has taken place, the set Mi is updated and tests involving dom^ formulas 
determine which strategies can currently be eliminated. Upon encountering such an 
epistemic formula the process calls the knowledge module to evaluate the considered 
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(a) Payoff of players 1 and 2 
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(b) Payoff of player 3 



1 . 1 concludes that U is dominated. I's pic- 
ture now: D 

2 . 2 communicates L ^jj R on {1, 2}. 

3 . 2 communicates L yjj R on {2, 3}. 

4 . 2 communicates R >~d L on {1,2}. 

5 . 2 communicates R >d L on {2, 3}. 

6 . 1 communicates D >~ U on {1, 2}. 

7 . 1 concludes that 2 knows that 1 knows that 

U is dominated. 

8 . 1 concludes that 2 knows that L is domi- 

nated. I's picture now: D 

9 . 2 concludes that 1 knows that U is domi- 

nated. 2's picture now: D 

10. 2 concludes that L is dominated. 2's pic- 
ture now: D 

11. 3 communicates B >l A on {2, 3}. 

12 . 3 communicates A^jiBon {2, 3}. 

1 3 . Communication is complete. 
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Figure 4: Protocol of program run for the game from Example 3.4 
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formula w.r.t. the current state. So the program refers directly to the epistemic formu- 



las. We shall return to this matter in Section 6. 1 The main loop of a process for player 
i terminates when all possible messages have been sent and received by i. 



We implemented this elimination procedure using Algorithm 1 in the distributed 
programming language Occam 1 18 1, which supports synchronous communication among 
pairs of processes. To support group communication synchronous broadcasts are re- 
quired, which are, for example, available in the language JCSP II26I . 

To illustrate this procedure consider the following example. 



Example 5.1. Consider again the game from Example 3.4 together with the hypergraph 
H — {{1, 2}, {2, 3}, {1, 3}}. The game is depicted in Figure 4 together with a trace 
of a program run in which players communicate their preferences and perform strategy 
elimination according to their respective current knowledge. 

Messages are abbreviated, e.g., L yjj i? represents two messages: L >ua R and 
one L yjjB R- When displaying a player's current picture of the game, we leave 
out the matrix entries since the numerical payoffs are never communicated, only the 
relative preferences. 

The outcome that the players arrive at after all communication allowed by H has 



taken place is, as expected, the same as in Example 3.4 for the reasons discussed there. 



While player 2 may deduce that player 3 would be able to eliminate B if player 3 knew 
that player 2 eliminated L, from the communicated information alone player 3 cannot 
deduce that. □ 



Note that in this particular run, in linef 



before player 2 actually computes it in line 1 



player 1 computes player 2's knowledge 
In that sense, player 1 for a certain 



amount of time ascribes knowledge to player 2 which player 2 does not yet have ex- 
pUcitly available. 



6 Conclusions 

We studied strategic games in the presence of interaction structures. We assumed that 
initially the players know only their own preferences, and that they can truthfully com- 
municate information about their own preferences within their parts of the interaction 
structure. This allowed us to analyze the consequences of locality, formalized by means 
of an interaction structure, on the outcome of the iterated elimination of strictly domi- 
nated strategies. To this end we appropriately adapted the framework introduced in 13] 
and showed that in any given state of communication this outcome can be described 
by means of epistemic analysis. We also discussed distributed implementations of the 
resulting procedures. 



6.1 Remarks on knowledge programming 



In Section 5.1 we allowed epistemic statements in the programs, realizing in this way a 
form of knowledge programming. Let us compare now this approach to those proposed 
in the Uterature. 
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The closely related topics of explicit knowledge and algorithmic knowledge 
nn l23l ^j] focus on what knowledge agent is able to compute, rather than just to 
possess. One approach is to limit the accessibility relations in certain ways, reflecting 
the assumption that accessing other possible worlds is computationally costly. These 
formalisms take a modeler's point of view in order to reason about what such an agent 
can do, rather than describing exactly how the agent does it. 

In contrast, in our approach we restrict the situations we consider, the initial knowl- 
edge, the ways in which new knowledge can be created (namely, by communication), 
as well as the class of epistemic statements. This simplifies the way the agents compute 
their knowledge, i.e., the epistemic formulas that are true from their local perspective. 

Another related approach is that of knowledge-based programs by Fagin et al. lfT3l . 
It resembles our approach in that epistemic statements are allowed to appear literally 
in the code of such programs. However, these knowledge-based programs are used 
exclusively for specification and verification of so-called standard programs, which 
do not contain epistemic statements. These resulting executable programs behave as 
required by their knowledge-based specification, but they are not assumed to actually 
"compute knowledge in any way". 

In contrast, in our approach epistemic statements are allowed in the programs, thus 
giving them explicit access to knowledge, through concrete algorithms with which they 
compute what is known to a player Programs containing epistemic statements are more 
natural and as a result easier to maintain than programs that behave equivalently, but 
are formulated on a lower level. In particular, the corresponding knowledge module 
(such as the one presented in Section 5.1 1 can be updated and verified separately. See 
II20I for an illustrating case study in the context of computer games. 

It is important to note that, as we have seen in the context of Example 5.1 this dif- 
ferent viewpoint also makes our notion of knowledge different from that of Fagin et al. 
lfT3l . Their notion of knowledge is defined in terms of possible runs of the whole dis- 
tributed system. We, on the other hand, take the subjective viewpoint of an intelligent 
agent and simulate epistemic reasoning of such an agent. 



6.2 Possible extensions 

It would be interesting to extend the analysis here presented in a number of ways, by: 

• allowing players to send information about the preferences of other players that 
they learned through interaction. The abstract epistemic framework of fSl in- 
cludes already this extension; 

• allowing other forms of messages, for example, messages containing information 
that a strategy has been eliminated, or containing epistemic statements, such as 
knowing that some strategy of another player has been eliminated; 

• considering formation or evolution of interaction structures, given strategic ad- 
vantages of certain interaction structures over others, 

• considering strategic aspects of communication, even if truthfulness is required 
(should one send some piece of information or not?). 
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The last point is discussed further in the subsection below. 

Finally, let us mention that in 1 3 1 we akeady abstracted from the framework con- 
sidered here and studied a setting in which players send messages that inform a group 
about some atomic fact that a player knows or has learned. We clarified there, among 
other things, under what conditions common knowledge of the underlying hypergraph 
matters. The framework there considered could be generalized by allowing players 
to jointly arrive at some conclusions using their background theories, by interaction 
through messages sent to groups. From this perspective lESDS could be seen as an 
instance of such a conclusion. Through its focus on the form of allowed messages and 
background knowledge, this study would differ from the line of research pursued by 
Fagin et al. 1 12 1, where the effects of communication are considered in the framework 
of distributed systems. 

6.3 Strategic communication 

Among the topics for future research especially incorporation of strategic communica- 
tion into our framework is an interesting challenge. Note that we do not examine here 
strategic or normative aspects of the communication. In fact, we do not allow players 
to lie and do not even examine why they communicate or what they should truthfully 
communicate to maximize their utilities. Rather, we examine what happens ;/ they do 
communicate, assuming that they are thruthful, rational and have reasoning powers. 

To justify this focus, it is helpful to realize that in some settings strategic aspects 
of communication are not relevant. One possibility is when communication is not a 
deliberate act, but rather occurs through observation of somebody's behavior Such 
communication is certainly more difficult to manipulate and more laborious to fake 
than mere words. In a sense it is inherently credible, and research in social learning 
argues along similar lines [8, Ch. 3]. 

In the setting of artificial agents communicating by messages, to view communica- 
tion as something non-deliberate is more problematic. Here, ignoring strategic aspects 
of communication can be interpreted as bounds on the players' rationality or reasoning 
capabilities — they simply lack the capabilities to deal with all the consequences of 
such an inherently rich phenomenon as communication. 

In general, strategic communication is a research topic on its own, with controver- 
sial discussions (see, e.g., [24|) and many questions open. Crawford and Sobel ifTOl 
have considered the topic in a probabilistic setting, and Farrell and Rabin 114] have 
looked at related issues under the notion of cheap talk. Also within epistemic logic, 
formalizations of the information content of strategic communication have been sug- 
gested, e.g., by Gerbrandy I.15J . 
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A Results used from Apt et al. ^ 



As described in Section 4.1 given some game we consider the basic propositions 

(atoms) At to consist of disjoint subsets At^, one for each player i. For each Si,s[ G Si, 
and s_i G S-i, At^ contains one atom s'^ . Sj. A valuation is a subset of At, 
consisting of those atoms that are true. We denote valuations by V and require that for 
each i and each s-i € S-i, the restriction y n {• >-s_i •} represents a strict partial 
order (so it may indeed be the preference order induced by some game)[^ 

A message has the form {i,A,s'^ ^s^i Si), where i & A G H, Si,s^ e Si, and 
S-i e S-i. A state is a tuple {V, M) where y is a valuation and M is a set of truthful 
messages (z, A,p), that is, indeed p g V. 



For a set of messages M, A C N, and p e At, M P is defined as in Sec 



tion 3.2 That is, M P means that p is entailed by the messages in M received by 
A, for example, by transitivity of the represented preference order. 

In Q, we defined set operations to act component-wise on states, e.g. (V, M) C 
{V , M') iff y C y and A/ C M' . However, the results we consider also hold with 
a modified inclusion relation, where M C M' iff for each {i,A,p) e M there is 
{i,A',p) e M' with AC A'. 

We define an indistinguishability relation between states: 

(F, M) ~, (r, M') iff (y , Af,) = (y/, M'i). 

For ACL N the relation is the transitive closure of UieA ^i- 
We consider the following positive epistemic language £+: 

where the atoms p denote the facts in At, ^, A and V are the standard connectives; and 
Ca is a knowledge operator, with Cap meaning ip is common knowledge among A. 
We write Ki for C^iy, Kiip can be read 'i knows that (/?'. For a sequence of players 
w = ii . . .ik,we write to abbreviate Ki-^ Ki^ . . . Ki^ . 
The semantics is defined as follows: 

Definition A.l. 

(y,M)Np iffpev, 

(y,M)N(/5VV' iff (y, M) N 9? or (y, M) N V-, 

(y, M) N ^ A ?/> iff (y, M) N if and {V, M) N V, 

(y, M) N Ca'P iff {V, M') N for each {V\ M') 

with (y,M) -A (y',M'). 

^ In |3] we did not consider such restrictions on valuations; liowever, tlie relevant results can easily be 
seen to remain correct. See also |27. Chapter 2]. 
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Now we are ready to state the following results from ||3], slightly adapted to fit our 
notation. 

Lemma A.2 (from ^ Lemma 3.2]). For any ip £ C'^ and states {V, M) and {V , M') 
with (F, M) C (!/', M'), 

if {V, M) N V?, then {V' , M') N Lp. 

Theorem A.3 (from |3, Theorem 3.5]). For any ipi,(p2 G C^, state (V, M), and 
ACN, 

(V, M) N Ca{vi V V2) iffiV, M) N CaVi V CaV2. 

Lemma A.4 (from ||27l Lemma 2.3.8], cf. (3] Lemma 3.7]). For any A (Z N with 
1^1 > 2, p G At, and state {V, M), the following are equivalent: 

(i) M UN p, 

(ii) {V, M) N Cap 

Theorem A.5 (from IS Theorem 3.8]). For any A C N, ip e £+, and state {V, M), 
(V, M) N ijf{^^ M) N K^ijip for some permutation w of A. 

B Omitted Proofs 

Proof of \Lemma 3.7] We show that for all fc > each globally (strictly) dominated 
strategy is also locally dominated in . Together with the straightforward fact that 
local dominance implies global dominance, this proves the desired equivalence. 

Formally, the claim is thus that for all fc > 0, Si E Si and s'^ E Gi such that 
Si >gk there is s'/ E with s'/ )^gk_ s[. 

To show this we prove by induction that for all fc > and Si E Si, there is s" E Gf 
such that s" ^gk Sj, from which the claim follows since s" ^gk Si and Si >gk s\ 
imply s'l >-gk_^ s',. 

This claim clearly holds for fc = 0. Now assume the statement holds for some fc 
and fix Si E Si. Choose some s'^ E Si that is ^gk -maximal among the elements of 

Si. By the induction hypothesis there is s" E Gi such that s" ^gk s'^. So also s" is 
^gfc -maximal among the elements of Si. Hence s" E {sd^ {G^))i. 

From sd3{G^) C G^"'^ we now obtain s'l E G-^^. From g'^+i C G'' and s'/ -^gk^ 
s^, we obtain s" hgk+i s'^, and by the maximality of s^, we also have s'^ ^gk+i Si. 
Thus, s'i E Gi^^ and s" hgk+i Si, which concludes the proof of the induction step. 

□ 



Proof of Theorem 3.3 First, consider </> = sd^, and A C A' C TV. By definition, this 



implies that for all restrictions G' we have Ta'{G') C Ta{G'). Since (j) is monotonic. 
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so is the operator Tc for all C C N. Hence by a straightforward induction C 
for all A C N, and consequently, for all players i, 

Tn ^ r\A:i<£Ai£H'^A ■ (1) 

Hence, for all i E N, 

where the inclusion holds by the monotonicity of T^i}- Consequently C Q{H). 

We now prove the same claim for = sd^. We need to distinguish the Tc operator 
for (f) = sd^ and = sd^ . In the former case we write Tc^t and in the latter case 
Tc.g. The reason that we use the latter operators is that they are monotonic and closely 
related to the former operators. As a consequence of Lemma 3.1 ~ '^c'g- Now 
fix an arbitrary i E N, then 

AAeAeH A,g — \ \A:ieAeH A/' 

and by Q f or ^ = sd^, T-^ C n^.e^eH ^Xs' 

^NJ — ^N,g ^ I \A:ieAeH ^A,£- 

Further, we have T-, = T^^ and T^^ = r{,},,(r^^), so T-, - r{,},,(T-,). 
Hence, by (|2]i and monotonicity of T[i}.g, 

Tn/ = T{i},g{T^^g) C T^i} ^g{r\A:ieAeH ^^A^e) ■ 
Also, for alH <E and all restrictions Q' we have, by definition, 

so by the last inclusion 

C T^i}Ar\A:ieAeH '^A^e) ■ 
Consequently, C G{H), as desired. 

□ 



In order to prove Theorem 3.7 we need an auxiliary lemma dealing with operators 
in a general setting. Given Y E D and an operator T on a finite lattice (-D, C), we 
denote by TV the following operator: 

Ty{X) ■.^T{X)U{XnY). 

Note B.l. If the T operator is contracting, then so is Ty. 

Lemma B.2. Suppose that T and U are operators on a finite lattice {D, C) such that 
T is monotonic and contracting. Then T^aof^u^ (C/°°) — D U°°. 
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Informally, this claim states that the combined effect of independent limit iterations 
of T and U can be modelled by 'serial' limit iterations of T and U, provided the 
operator T is modified to an appropriate Ty form. 



Proof. Denote for brevity T°° n [/°° by Y . First we prove by induction that for all 

A: > 

Y C T^(C/°°). 

The claim clearly holds for fc = 0. Suppose it holds for some fc > 0. Then by the 
induction hypothesis 



Hence 



(3) 



Y C T^{U°°). 

To prove the converse implication we show by induction that for all fc > 

Ty(C/°°) C 

The claim clearly holds for fc = 0. Suppose it holds for some fc > 0. Then by the 
induction hypothesis and the monotonicity of T 

T^+^{u°°) = Ty{t^{u°°)) c Ty(r'=) = t''+^ u {t'' nY) c t''+^(jt°° c t'=+\ 

Hence 



Next, by Note B.l the operator Ty is contracting, so 

T^{U°°) C U°°. 
Now the claim follows by (|3]l, Q and (|5]l. 



(4) 

(5) 

□ 



Proof oj frheorem 3.7\ Recall that H denotes the closure of H under non-empty inter- 
section. Fix an interaction structure H, a set of messages AI and i £ N. Assume for 
simplicity that the set {A \ i £ A £ H} has exactly two elements, say, Bi and Ci. 
To deal with the arbitrary situation Lemma B.2 needs to be generalized to an arbitrary 
number of operators. Such a generalization is straightforward and omitted. 
Let now 



Q2 



(Si, ... , Sn), 

(Gi), 



.M 



To 



^T^^}{G,), 



where 



Tc..m{G) ■■= Tc,m{G) u n r-_^, n ^,). 

Now, recall that 



A-.ieAeH ^AM 



Tam)), 
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By Lemma B.2 ^3 = T^.a/ H T^^a/' so (^4)^ is g{H, M)„ the ith component of 
Q{H,M). Note B.l ensures that each of the operators Tc^.m ,TBi.M and Tc^^m is 



contracting. Moreover, sdP removes (weakly) more strategies than each of them, so 
the sequence of restrictions 

Ql, Tb^m{Qi), 7s^,Af(^l)' ■ ■ ■ '^2, T'Ci,A/(^2), T'c'.,A/(^2), ■ • ■ , ^3, Qa 

satisfies the conditions of |Lemma 3.1| By |Lemma 3.1| we also obtain the same restric- 
tion when in the definition of the Tg. a/ and Tc\,m operators we use sd^ instead of 
sd^. So the ith component G{H, M)i of g{H, M) is the same when in the definitions 
of the Tb^.m, Tc-^m and T^jj. operators we use sg^ instead of sg^ . 

This concludes the proof. □ 



A:ieAeH jeA\{i} 



In order to prove Theorem 4.2 we need some preparatory steps. 
Lemma B.3. For any £ > 1, i £ N, st £ Si, and state {V, M), 

{V,M) N dom^+\s,) 
iff{V,M)^ V /\ [{K,s'^y,_^si)W V V CAdom'is,)]. 

Proof. We have 

{V,M) N dom'^+\s^) 
iff (by definition) 

{V,M)^K, V /\ K^,. 
iff (by \Theorem A.jf 



J<£N\{l} 



iff 



Si) V \/ Kidom\sj)] 
jeN\{i} 



To see that the downwards implication of the last step holds, note that dom (sj) 



Kjip for appropriate ip. With Theorem A. 5 KiKjip implies C^i jj(p. With an induc- 
tion starting from Lemma A.4 and using Theorem A. 3 this implies that there must 



be messages in M jointly observed by i and j that entail ip. Each of these messages 
must have been sent to some A E H, and so all messages have been observed by some 
Ae~H with i, j £ A. □ 

Lemma B.4. For any £ > 1, i £ A £ H, Si £ Si, and state {V, M), 

Proof. By induction on £. The base case follows straightforwardly from the definitions. 
Now assume the claim holds for £. Then, focusing on the interesting case where A ^ 
{i}, we have the following chain of equivalences: 
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iff (by definition) 

iff (by the contmctivity of sd^) 

iff (by definition) 

iff 

3s^ e 5, Vs_, g 5-, [M t^N s- s,; or 

S_i ^ (r4,M)-i] 

iff 

3s- e S, Vs_, G S'-j [M ^s-i Sj: or 

iff (by induction hypothesis) 

3s'^ e Vs_, e [M t^N Si or 

3j e v4 \ {i} {V, M) N CAdom^(sj)] 

iff ( by Lemma A.4\ 

3s[ e S, "is-, e [ [V, M) N Cas^ s, or 

3j e ^ \ {i} iy, M) N CArfom^(sj)] 

iff 

(y,M)N V /\ [Cas^^,_. s,V V CAdom\s,)] 

iff (by^heoremAJ^ 

{V,M)^Ca V A V dom\sj)] 

iff (by definition o/Ca) 

{V,M)^CaK, V /\ s,V V rfom^(s,)] 

iff ffey definition of dom^^^ {■)) 
{V,M) N C^dom'^+^sO. 



are now ready to prove the main result. 
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Proof of \Theo rem 4.2\ Let 

^ ■— ClA-.it^A^H'^AM- 
'We have: 

iff (by definition) 

Si ^ iT[iy^MiS'))i 

iff 

iff 

3s', e 5"^ Vs_i e S'L, Si 

iff 

3s- e 5^ Vs_i e S'_i (s- s, or s_i ^ S'^.j) 

iff 

3s^ e 5"^ Vs_i e S"-, ( s', s, or 

iff 

3s^ e 5"^ Vs_i e S"-, ( s[ ^s^, s, or 

3A:teAeH3jeA\{i}:s^^ (7^*/)^-) 

iff (by \Lemma 

3s- G 5, Vs_i e S-^ ( s^ or 

(y,Af)N V V CArfom°°(s,)) 
A:ieAeH 

iff (since s' Si G At^j 

3s^ e 5. Vs_, e ( (y, M) N if,s^ s, or 

(y,Af)N V V CArfom°°(s,)) 

A:i^A^H j<^A\{i} 

iff 

(y,M)N V /\ [(i^,s^ s,) V V V C^rfom°°(sj)] 

s^es. s_ies_i A:ieAeH 'jeA\{i} 

iff (by \Lemma 

{V,M)^ dom°°{s,). □ 
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